Address-Event based Stereo Vision with Bio-inspired Silicon Retina Imagers

نویسندگان

  • Jürgen Kogler
  • Christoph Sulzbachner
  • Martin Humenberger
  • Florian Eibensteiner
چکیده

Several industry, home, or automotive applications need 3D or at least range data of the observed environment to operate. Such applications are, e.g., driver assistance systems, home care systems, or 3D sensing and measurement for industrial production. State-of-the-art range sensors are laser range finders or laser scanners (LIDAR, light detection and ranging), time-of-flight (TOF) cameras, and ultrasonic sound sensors. All of them are embedded, which means that the sensors operate independently and have an integrated processing unit. This is advantageous because the processing power in the mentioned applications is limited and they are computationally intensive anyway. Another benefits of embedded systems are a low power consumption and a small form factor. Furthermore, embedded systems are full customizable by the developer and can be adapted to the specific application in an optimal way. A promising alternative to the mentioned sensors is stereo vision. Classic stereo vision uses a stereo camera setup, which is built up of two cameras (stereo camera head), mounted in parallel and separated by the baseline. It captures a synchronized stereo pair consisting of the left camera’s image and the right camera’s image. The main challenge of stereo vision is the reconstruction of 3D information of a scene captured from two different points of view. Each visible scene point is projected on the image planes of the cameras. Pixels which represent the same scene points on different image planes correspond to each other. These correspondences can then be used to determine the three dimensional position of the projected scene point in a defined coordinate system. In more detail, the horizontal displacement, called the disparity, is inverse proportional to the scene point’s depth. With this information and the camera’s intrinsic parameters (principal point and focal length), the 3D position can be reconstructed. Fig. 1 shows a typical stereo camera setup. The projections of scene point P are pl and pr. Once the correspondences are found, the disparity is calculated with

برای دانلود رایگان متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

ثبت نام

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

Address-event Matching for a Silicon Retina Based Stereo Vision System

In this paper we present a stereo vision system based on silicon retina sensors. Derived from the human vision system, these bio-inspired silicon retina sensors are a new type of imagers. Conventional optical sensors capture images at a fixed frame-rate and deliver pixel information of the sensor chip at a certain point in time. In contrast, a silicon retina optical sensor provides only intensi...

متن کامل

Bio-inspired Stereo Vision System with Silicon Retina Imagers

This paper presents a silicon retina-based stereo vision system, which is used for a pre-crash warning application for side impacts. We use silicon retina imagers for this task, because the advantages of the camera, derived from the human vision system, are high temporal resolution up to 1ms and the handling of various lighting conditions with a dynamic range of ∼120dB. A silicon retina deliver...

متن کامل

Stereo-Vision Algorithm Based on Bio-Inspired Silicon Retinas for Implementation in Hardware

In this paper, we propose a silicon-retina-based stereo vision system, used for pre-crash warning or rather side-impact detection applications in vehicles. The bio-inspired silicon retina sensor is a new kind of sensor, which delivers data asynchronously and only if the intensity of the ambient light changes. Therefore, the amount of data that must be processed decreases significantly compared ...

متن کامل

Address - Event based Stereo Vision with Bio - inspired Silicon Retina Imagers 3

Several industry, home, or automotive applications need 3D or at least range data of the observed environment to operate. Such applications are, e.g., driver assistance systems, home care systems, or 3D sensing and measurement for industrial production. State-of-the-art range sensors are laser range finders or laser scanners (LIDAR, light detection and ranging), time-of-flight (TOF) cameras, an...

متن کامل

Low-level Stereo Matching using Event-based Silicon Retinas

This semester thesis examines the task of computing stereo image disparities using a binocular pair of event-based silicon retinas [1]. Unlike conventional video cameras, this silicon retina is asynchronous and event-based. It responds to reflectance change and thus the events primarily encode object movement. Therefore there is no global frame rate. Two different algorithms were devised to do ...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

عنوان ژورنال:

دوره   شماره 

صفحات  -

تاریخ انتشار 2011